Vehicle-Based Media System with Audio Ad and Navigation-Related Action Synchronization Feature

ABSTRACT

In one aspect, an example method to be performed by a vehicle-based media system includes (a) receiving audio content; (b) causing one or more speakers to output the received audio content; (c) using a microphone of the vehicle-based media system to capture the output audio content; (d) identifying reference audio content that has at least a threshold extent of similarity with the captured audio content; (e) identifying a geographic location associated with the identified reference audio content; and (f) based at least on the identified geographic location associated with the identified reference audio content, outputting, via the user interface of the vehicle-based media system, a prompt to navigate to the identified geographic location.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.16/997,709, filed Aug. 19, 2020, which is a continuation of U.S. patentapplication Ser. No. 16/516,035, filed on Jul. 18, 2019, which claimspriority to U.S. Provisional Patent Application No. 62/714,619, filed onAug. 3, 2018, U.S. Provisional Patent Application No. 62/714,621, filedon Aug. 3, 2018, and U.S. Provisional Patent Application No. 62/714,623,filed on Aug. 3, 2018, each of which is hereby incorporated by referencein its entirety. Additionally, this application hereby incorporates byreference the entire contents of U.S. patent application Ser. No.16/516,029, filed on Jul. 18, 2019 and U.S. patent application Ser. No.16/516,045, filed on Jul. 18, 2019.

Usage and Terminology

In this disclosure, unless otherwise specified and/or unless theparticular context clearly dictates otherwise, the terms “a” or “an”mean at least one, and the term “the” means the at least one.

In this disclosure, the term “connection mechanism” means a mechanismthat facilitates communication between two or more components, devices,systems, or other entities. A connection mechanism can be a relativelysimple mechanism, such as a cable or system bus, or a relatively complexmechanism, such as a packet-based communication network (e.g., theInternet). In some instances, a connection mechanism can include anon-tangible medium (e.g., in the case where the connection iswireless).

BACKGROUND

Vehicle-based media systems can receive media content to be presented toan occupant of a vehicle. For example, a vehicle-based media system caninclude an antenna configured to receive a radio signal, such as asatellite radio signal or a terrestrial radio signal, that is carryingaudio content, and the vehicle-based media system can output the audiocontent through one or more speakers located within the vehicle.

SUMMARY

In one aspect, an example vehicle-based media system is disclosed. Theexample vehicle-based media system comprises (a) a user interface, (b) amicrophone, (c) one or more processors, and (d) a non-transitory,computer-readable medium storing instructions that, when executed by theone or more processors, cause the vehicle-based media system to performa set of acts comprising: (a) receiving audio content; (b) causing oneor more speakers to output the received audio content; (c) using themicrophone of the vehicle-based media system to capture the output audiocontent; (d) identifying reference audio content that has at least athreshold extent of similarity with the captured audio content; (e)identifying a geographic location associated with the identifiedreference audio content; and (f) based at least on the identifiedgeographic location associated with the identified reference audiocontent, outputting, via the user interface of the vehicle-based mediasystem, a prompt to navigate to the identified geographic location.

In another aspect, an example method to be performed by a vehicle-basedmedia system is disclosed. The method includes (a) receiving audiocontent; (b) causing one or more speakers to output the received audiocontent; (c) using a microphone of the vehicle-based media system tocapture the output audio content; (d) identifying reference audiocontent that has at least a threshold extent of similarity with thecaptured audio content; (e) identifying a geographic location associatedwith the identified reference audio content; and (f) based at least onthe identified geographic location associated with the identifiedreference audio content, outputting, via a user interface of thevehicle-based media system, a prompt to navigate to the identifiedgeographic location.

In another aspect, an example non-transitory computer-readable medium isdisclosed. The computer-readable medium has stored thereon programinstructions that, upon execution by a vehicle-based media system, causethe vehicle-based media system to perform a set of operations comprising(a) receiving audio content; (b) causing one or more speakers to outputthe received audio content; (c) using a microphone of the vehicle-basedmedia system to capture the output audio content; (d) identifyingreference audio content that has at least a threshold extent ofsimilarity with the captured audio content; (e) identifying a geographiclocation associated with the identified reference audio content; and (f)based at least on the identified geographic location associated with theidentified reference audio content, outputting, via a user interface ofthe vehicle-based media system, a prompt to navigate to the identifiedgeographic location.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a simplified block diagram of an example computing device.

FIG. 2A is an example graphical user interface (“GUI”) in a first state.

FIG. 2B is the example GUI of FIG. 2A, but in a second state.

FIG. 2C is the example GUI of FIG. 2A, but in a third state.

FIG. 3A is an example GUI in a first state.

FIG. 3B is the example GUI of FIG. 3A, but in a second state.

FIG. 3C is the example GUI of FIG. 3A, but in a third state.

FIG. 4 is a flow chart of an example method.

DETAILED DESCRIPTION I. Overview

A vehicle-based media system receives audio content over a radiobroadcast and presents the received audio content to an occupant of avehicle, for instance, by playing the audio content through one or morespeakers of the vehicle. The audio content received and played back bythe vehicle-based media system can include various types of audiocontent. For instance, the audio content can include primary content,such as music, radio programs, or the like, and the audio content caninclude secondary content, such as advertisements, interspersed amongthe primary content.

Some vehicle-based media systems include a visual display for displayingvisual information to an occupant of a vehicle. Such a vehicle-basedmedia system can be configured to display information related to audiocontent being played back by the media system. For instance, while themedia system is playing audio content, the media system can cause thevisual display to display information identifying the audio content,such as a title and/or artist of a song, or identifying a source of theaudio content, such as a radio station that is broadcasting the audiocontent. Such information to be displayed by the vehicle-based mediasystem can be encoded in the radio broadcast that is carrying the audiocontent, and the vehicle-based media system can extract this informationfrom the radio broadcast.

In practice, when the vehicle-based media system receives primarycontent from the radio broadcast, such as a song or a radio program, thevehicle-based media system can obtain, from the radio broadcast, anddisplay, via its visual display, information identifying the song orradio program and/or a source of the song or radio program. Forinstance, for a terrestrial radio broadcast, such as a frequencymodulation (FM) radio broadcast, information can be encoded into theradio signal according to the Radio Broadcast Data System (RBDS)communication protocol. Other examples are possible as well.

In some scenarios, however, the vehicle-based media system might notreceive from the radio broadcast any visual information to be displayed,or the occupant of the vehicle may wish to receive additional oralternative information than that which the vehicle-based media systemreceives from the radio broadcast. For instance, when the vehicle-basedmedia system receives secondary content, such as an advertisement, fromthe radio broadcast, the radio signal may not be encoded with visualinformation for display by the vehicle-based media system, or the radiosignal may merely be encoded with visual information identifying theradio station broadcasting the advertisement or with various othervisual information unrelated to the content of the advertisement.However, an occupant of the vehicle may wish to obtain furtherinformation about the advertisement, and/or a business associated withthe advertisement may wish to provide further information to theoccupant of the vehicle.

Disclosed herein are methods and systems to address this and potentiallyother issues. In an example method, while a vehicle-based media systemis presenting an audio advertisement, the vehicle-based media systemdetermines an audio fingerprint of the advertisement and thevehicle-based media system also determines location data associated withthe vehicle. The location data can include a current location of thevehicle, a destined location of the vehicle, or some location on a routebetween the current and destined locations of the vehicle, as obtainedfrom a navigation system of the vehicle. The vehicle-based media systemuses both the determined audio fingerprint of the advertisement and thelocation data associated with the vehicle to select and perform anavigation-related action.

In a further aspect, the vehicle-based media system can receivedifferent kinds of audio content. This received audio content can alsobe different types of audio content, including music by various artistsor other radio programs (collectively, “entertainment content”) and/oraudio advertisements (collectively, “advertisement content”).

Once this audio content is received, the vehicle-based media system mayalso cause one or more speakers in (or around) the vehicle to output thereceived audio content, and then, using a microphone of the system,capture the outputted audio content. In some examples, the vehicle-basedmedia system can also selectively capture the audio content based onvarious attributes of the received audio content (e.g., capturing theadvertisement content).

The vehicle-based media system may also identify reference audio contentthat has at least a threshold extent of similarity with the capturedaudio content and can do so in various ways. For instance, the referenceaudio content can include a plurality of reference audio fingerprintitems, and the vehicle-based media system can generate audio fingerprintdata associated with the captured audio content, compare the generatedaudio fingerprint data to the plurality of reference audio fingerprintitems, and determine that a particular reference audio fingerprint itemof the plurality of reference audio fingerprint items has at least athreshold extent of similarity with the generated audio fingerprintdata. In another aspect, the vehicle-based media system may do some orall of this analysis locally or using other devices and/or processes(e.g., the vehicle-based media system can send the captured audiocontent (or a portion thereof) to a server, and the server can generateaudio fingerprint data associated with the captured audio content and/orperform the comparative analysis). And, in yet another aspect, thevehicle-based media system can also identify reference audio contentbased on specific audio content with specific attributes (e.g.,capturing advertisement content contained in the received audio contentand using the captured advertisement content to identify reference audiocontent).

In any case, the vehicle-based media system may also use the identifiedreference audio content to identify a geographic location associatedwith the identified reference audio content. Namely, the vehicle-basedmedia system may use the reference audio content that has the thresholdextent of similarity with the captured audio content to a geographiclocation associated with the underlying advertisement content. Forinstance, the threshold similar reference audio content can beassociated with a particular geographic location, and the vehicle-basedmedia system can retrieve the particular geographic location based onits association with the threshold similar reference audio content item.

Further, the vehicle-based media system may output, via the userinterface of the vehicle-based media system, a prompt to navigate to theidentified geographic location, and may do so in a number of ways. Forexample, the identified geographic location may be related to particularadvertisement content contained in the captured audio content and may bedisplayed while the audio advertisement is playing in the vehicle. In afurther aspect, by displaying this geographic location, the additionalcontent can increase opportunities for (and the likelihood of) anoccupant's interactions with the advertisement content. Further,displaying this geographic location corresponding to a particularadvertisement may include displaying directions for navigating theoccupant of the vehicle to that the displayed location, and may do so ina number of ways.

In one example, the geographic location corresponding to a particularadvertisement may be a first geographic location (e.g., a nearbylocation of a restaurant associated with the advertisement content) andthe vehicle-based media system can determine a second geographiclocation associated with the vehicle-based media system (e.g., thecurrent geographic location of the vehicle in which the vehicle-basedmedia system is located). Based on this determination, the vehicle-basedmedia system can perform a number of additional actions, includingdetermining a destined geographic location (e.g., the restaurant in theadvertisement content) and displaying a route between the currentgeographic location of the vehicle-based media system and the destinedgeographic location. In a further aspect, prior to displaying thisroute, the vehicle-based media system can display a prompt for anoccupant of the vehicle to determine and display the route. In yet afurther aspect, the vehicle-based media system may also receive inputfrom the occupant via the displayed prompt and, in response to receivinginput from the user, display one or more nearby locations of thebusiness associated with the advertisement content (e.g., display anindication of one or more geographic locations of the associatedbusiness).

II. Example Architecture

A. Computing Device

FIG. 1 is a simplified block diagram of an example computing device 100.Computing device 100 can perform various acts and/or functions, such asthose described in this disclosure. Computing device 100 can includevarious components, such as processor 102, data storage unit 104,communication interface 106, and/or user interface 108. These componentscan be connected to each other (or to another device, system, or otherentity) via connection mechanism 110.

Processor 102 can include a general-purpose processor (e.g., amicroprocessor) and/or a special-purpose processor (e.g., a digitalsignal processor (DSP)).

Data storage unit 104 can include one or more volatile, non-volatile,removable, and/or non-removable storage components, such as magnetic,optical, or flash storage, and/or can be integrated in whole or in partwith processor 102. Further, data storage unit 104 can take the form ofa non-transitory computer-readable storage medium, having stored thereonprogram instructions (e.g., compiled or non-compiled program logicand/or machine code) that, when executed by processor 102, causecomputing device 100 to perform one or more acts and/or functions, suchas those described in this disclosure. As such, computing device 100 canbe configured to perform one or more acts and/or functions, such asthose described in this disclosure. Such program instructions can defineand/or be part of a discrete software application. In some instances,computing device 100 can execute program instructions in response toreceiving an input, such as from communication interface 106 and/or userinterface 108. Data storage unit 104 can also store other types of data,such as those types described in this disclosure.

Communication interface 106 can allow computing device 100 to connect toand/or communicate with another other entity according to one or moreprotocols. In one example, communication interface 106 can be a wiredinterface, such as an Ethernet interface or a high-definitionserial-digital-interface (HD-SDI). In another example, communicationinterface 106 can be a wireless interface, such as a radio, cellular, orWI-FI interface. In this disclosure, a connection can be a directconnection or an indirect connection, the latter being a connection thatpasses through and/or traverses one or more entities, such as such as arouter, switcher, or other network device. Likewise, in this disclosure,a transmission can be a direct transmission or an indirect transmission.

User interface 108 can facilitate interaction between computing device100 and a user of computing device 100, if applicable. As such, userinterface 108 can include input components such as a keyboard, a keypad,a mouse, a touch-sensitive panel, a microphone, and/or a camera, and/oroutput components such as a display device (which, for example, can becombined with a touch-sensitive panel), a sound speaker, and/or a hapticfeedback system. More generally, user interface 108 can include hardwareand/or software components that facilitate interaction between computingdevice 100 and the user of the computing device 100.

In this disclosure, the term “computing system” means a system thatincludes at least one computing device, such as computing device 100. Acomputing system and/or components thereof can perform various acts,such as those set forth below.

In this disclosure, the term “vehicle-based media system” means a systemthat includes at least one computing device, such as computing device100, and that receives and presents media content to an occupant of avehicle. The vehicle-based media system can receive the media contentusing a communication interface, such as communication interface 106,and can present the media content using a user interface, such as userinterface 108.

II. Example Operations

In line with the discussion above, a vehicle-based media system canreceive, via a radio broadcast, an audio advertisement, and thevehicle-based media system can present the audio advertisement to anoccupant of the vehicle by outputting the audio advertisement throughone or more speakers of the vehicle. To enhance the occupant'sexperience, the vehicle-based media system can identify theadvertisement and can use the identified advertisement as a basis toretrieve a geographic location associated with the identified referenceaudio content. The vehicle-based media system can then cause theretrieved geographic location to be presented on a display screen of thevehicle-based media system while the vehicle-based media system presentsat least a portion of the advertisement. In one example use case, thevehicle-based media system can receive and present a terrestrial radioadvertisement for a restaurant and while doing so, the vehicle-basedmedia system can display one or more nearby locations of the advertisedrestaurant together with a prompt for displaying directions to one ofthe advertised restaurants.

One way to identify the advertisement being received by thevehicle-based media system is for the vehicle-based media system togenerate audio fingerprint data representing the advertisement contentbeing received by the vehicle-based media system, and for a computingsystem, such as a network server, to compare that audio fingerprint datawith reference audio fingerprint data representing advertisement contentof a known advertisement, with a fingerprint match indicating that thevehicle-based media system is receiving the known advertisement.

To do so, the vehicle-based media system may use one or more microphonesto capture audio content that is played via one or more speakers in thevehicle. For instance, the vehicle-based media system may receivevarious audio content from a particular source (e.g., both entertainmentand advertisement content contained in signals from a terrestrial radiostation) and selectively capture specific audio content (e.g.,advertisement content) for further analysis. To facilitate this, thevehicle-based media system may be configured to continuously monitoraudio content that is being played in the vehicle during backgroundprocessing and begin capturing the audio only upon recognizing one ormore predetermined audio patterns. For instance, the vehicle-based mediasystem can be configured to begin capturing audio content responsive todetecting a period of silence or lack of music content, as this can beindicative of the end of a song and the beginning of an advertisement.

In another example, the vehicle-based media system can be configured tocapture audio content responsive to detecting changes in the receivedaudio content. For instance, the vehicle-based media system can beconfigured to determine that the received audio content no longerincludes information identifying the song or radio program and/or asource of the song or radio program, such as information encoded intothe radio signal according to the RBDS communication protocol. As notedabove, this encoded information might not be present when the receivedaudio content includes advertisement content, and so the lack of thisencoded information can indicate that the received audio contentincludes advertisement content.

In another example, the vehicle-based media system may be configured tocontinuously or periodically monitor the audio content that is beingplayed in the vehicle and capture the audio content for furtheranalysis. In some examples, the vehicle-based media system mayperiodically capture the audio content and perform audio analysis (e.g.,fingerprinting, finding other audio content that matches the capturedaudio content, etc.) in real time or near real time. In other examples,however, the vehicle-based media system may periodically capture theaudio content and defer audio analysis until a later time.

In still other examples, the vehicle-based media system may engage theone or more microphones to capture audio content based on the presence(or absence) or particular information in the received audio content. Insome examples, the vehicle-based media system may begin capturing audiocontent playing back in the vehicle in response to determining that thereceived audio content does not contain information indicating that theaudio content is musical audio content (e.g., song and/or artist title),and therefore is likely advertising content. Other examples arepossible.

In any case, the vehicle-based media system can determine a fingerprintfor the captured audio content, and may do so in a number of ways. Forexample, a network server or other such entity could establish orotherwise have access to reference audio fingerprint data representing aknown advertisement. For instance, the server could receive variousaudio advertisements and, for each audio advertisement, could generaterespective reference audio fingerprints representing the respectiveaudio advertisements. Or the server could otherwise establish or beprovisioned with these reference audio fingerprints. The fingerprintsdetermined by the vehicle-based media system and/or the reference audiofingerprints can be generated according to any audio fingerprintingprocess now known or later developed.

Further, in real time as the vehicle-based media system receives anaudio advertisement, the vehicle-based media system could generate queryaudio fingerprint data representing the audio content of theadvertisement that it is receiving and could transmit the query audiofingerprint data to the server for analysis.

As the server receives the query audio fingerprint data from thevehicle-based media system, the server could compare the query audiofingerprint data with the reference audio fingerprint data of the knownadvertisements. And if the server thereby determines with sufficientconfidence that the query audio fingerprint data matches particularreference audio fingerprint data, then the server could conclude thatthe advertisement being received by the vehicle-based media system isthe known advertisement represented by the particular reference audiofingerprint data. Further, upon reaching such a conclusion, the servercould transmit, to the vehicle-based media system, informationassociated with the advertisement (e.g., a logo, a brand name, etc.,associated with the advertisement and/or the associated business).

In other examples, once the advertisement that is being received by thevehicle-based media system has been identified, the identifiedadvertisement can be used as a basis to retrieve a geographic locationassociated with the identified reference content. For instance, theserver could receive or be provisioned with respective geographiclocation data associated with each respective known advertisement, andthe vehicle-based media system could retrieve, from the server, therespective geographic location (or locations) associated with theidentified advertisement. In yet other examples, the vehicle-based mediasystem may perform some or all of these functions locally, on the systemitself.

Additionally, the vehicle-based media system can determine location dataindicating a geographic location associated with a vehicle in which thevehicle-based media system is operating. For example, the vehicle-basedmedia system can include a navigation system configured to use a GPSmodule to identify a current location of the vehicle and a destinedlocation of the vehicle and to provide directions for navigating to thedestined location. As such, the vehicle-based media system can query thenavigation system for the current location of the vehicle, the destinedlocation of the vehicle, or any location on a route between the currentand destined locations. Other examples are possible.

The vehicle-based media system can use both the identified advertisementand the determined location data as a basis to select and perform anavigation-related action. As noted above, for instance, thevehicle-based media system can use the identified advertisement and thedetermined location data to navigate the vehicle to a business locationassociated with the identified advertisement. To facilitate this, theserver could receive or be provisioned with respective location dataassociated with each respective known advertisement. The respectivelocation data could include a location (e.g., an address or GPScoordinates) of a business associated with the respective advertisement.Accordingly, once the advertisement that is being received by thevehicle-based media system has been identified, the identifiedadvertisement can be used as a basis to retrieve respective locationdata associated with the identified advertisement. And the vehicle-basedmedia system can present, via its display, a prompt to navigate thevehicle to the location associated with the identified advertisement.Responsive to the occupant selecting the prompt, the vehicle-based mediasystem can cause the navigation system to display a navigational routebeginning at the vehicle's current location and ending at the locationassociated with the identified advertisement. The system can displaythis prompt in various forms and use this geographic location data invarious ways, as explained in further detail below.

In one example, the vehicle-based media system can use the geographiclocation corresponding to a particular advertisement as a firstgeographic location (e.g., a nearby location of the restaurantassociated with the advertisement content) and can determine a secondgeographic location associated with the vehicle-based media system(e.g., the current geographic location of the vehicle in which thevehicle-based media system is located). Based on this determination, thevehicle-based media system can perform a number of additional actions,including determining a destined geographic location (e.g., therestaurant in the advertisement content) and display a route between thecurrent geographic location of the vehicle-based media system and thedestined geographic location.

In yet another aspect, the vehicle-based media system, prior todisplaying this route, can display a prompt for an occupant of thevehicle to navigate to the destined location and display directions, viathe vehicle-based media system, to navigate the vehicle to the destinedlocation. In yet a further aspect, the vehicle-based media system mayalso receive input from the occupant via the displayed prompt and,pursuant to receiving input from the user, display one or more nearbylocations of the business associated with the advertisement content(e.g., display an indication of one or more geographic locations of theassociated business). In this manner, the vehicle-based media system canreceive and present a terrestrial radio advertisement, such as for arestaurant chain, and while doing so, the media system can display alocation of one of the restaurants.

In some examples, the vehicle-based media system can also use thedetermined location data of the vehicle to determine whether to performnavigation-related actions (e.g., route the vehicle to a particulargeographic location associated with the advertisement content). Tofacilitate this, the server can be further provisioned with respectivelocation data associated with each respective advertisement. Forinstance, the location data for a particular advertisement can includean address or GPS coordinates of a business associated with theadvertisement. In such a scenario, the vehicle-based media system can beconfigured to only retrieve geographic location data for advertisementsthat are associated with a location within a thresholdproximity/distance (e.g., within a five mile radius) of the currentlocation of the vehicle, destined location of the vehicle, or somelocation on a route between the current and destined locations.

Alternatively, the vehicle-based media system can determine that thevehicle location data identifies a location that is not within thethreshold proximity/distance to the location associated with theparticular advertisement. In such a scenario, even if a fingerprintmatch is detected when comparing the query audio fingerprint data withthe reference audio fingerprint data of the particular advertisement,the vehicle-based media system can refrain from retrieving anddisplaying geographic location data associated with the matchedreference fingerprint data based on the matched reference fingerprintdata being associated with a location that is at least the thresholdproximity/distance away from the location indicated by the vehiclelocation data.

Further, in some examples, location data for a particular advertisementcan include location data for multiple locations. For instance, as notedabove, the particular advertisement might be an advertisement for achain of restaurants, and the location data for the particularadvertisement can include location data for each restaurant of the chainof restaurants. As such, the vehicle-based media system can beconfigured to consider the nearest restaurant location when determiningwhether to perform the navigation-related action. For instance, if thenearest restaurant is within the threshold proximity/distance of thevehicle-based media system location, then the vehicle-based media systemcan perform the navigation-related action, such as by displaying aprompt to navigate the vehicle to the nearest restaurant location.Alternatively, if the nearest restaurant is not within the thresholdproximity/distance of the vehicle-based media system location, then thevehicle-based media system can refrain from performing thenavigation-related action.

Additionally or alternatively, the vehicle-based media system can alsodisplay one or more suggested geographic locations associated with theadvertisement content (and directions for navigating to these to thesame) based on various attributes of the received geographic locationdata (e.g., a prompt for navigating to the closest geographic locationassociated with the advertisement, the geographic location with besttraffic conditions for navigating thereto, etc.).

In any event, the vehicle-based media system, an occupant's mobiledevice, or both may take actions that result in additional contentrelated to the advertisement being displayed for one or more occupantsand thereby increase therein interactions with (and interest in) theadvertisement (and the underlying business/products/services advertisedtherein). In a further aspect, the vehicle-based media system may alsostore the associated information (e.g., reference audio content,associated visual content, the occupant's interactions with thegeographic location, or all of the above) for future use by the mediasystem.

A. Example GUIs and Operational Environments

To further illustrate the above-described concepts and others, FIGS.2A-2C depict example GUIs that a vehicle-based media system 200 can beconfigured to display in accordance with the techniques described above.The vehicle-based media system 200 can include one or more computingdevices similar to or the same as the computing device 100 depicted inFIG. 1 . Further, the example environments and GUIs depicted in FIGS.2A-2C are merely for purposes of illustration. The features describedherein can involve environments, operations, GUIs, and functionalitiesthat are configured or formatted differently, include additional orfewer components and/or more or less data, include different types ofcomponents and/or data, and relate to one another in different ways.

FIG. 2A depicts an example GUI of the vehicle-based media system 200 ina first state. Specifically, in this first state, the vehicle-basedmedia system 200 displays a radio station 202 (“95.5”) in connectionwith an associated radio station logo 204 (“Hot 95.5”) and informationindicating a song title 206 (“Brimstone”), artist title 208 (“TheWayward Kin”), and album title 210 (“Meanwhile in Mississippi . . . ”),for musical audio content received from the displayed radio station andcurrently playing on one or more speakers in the vehicle. In line withthe discussion above, this information can be encoded into audio contentreceived by the vehicle-based media system, and the vehicle-based mediasystem can extract this information from the received audio content.

Turning to FIG. 2B, FIG. 2B depicts the GUI of vehicle-based mediasystem 200 depicted in FIG. 2A, but in a second state. In the secondstate, the audio content received by the vehicle-based media system 200includes advertisement content instead of entertainment content. In thisstate, instead of displaying information indicating a song title 206,artist title 208, and album title 210 associated with musical audiocontent playing in the vehicle, vehicle-based media system 200 displayscontent associated with the advertisement playing on the radio station.During playout of this advertisement, the vehicle-based media system 200captures the advertisement audio content currently playing on one ormore speakers in the vehicle.

In line with the discussion above, the vehicle-based media system 200can capture the advertisement audio content in a number of ways. Forexample, vehicle-based media system 200 can include one or moremicrophones that the vehicle-based media system 200 can use to captureaudio content playing in the vehicle during an advertisement. Further,the vehicle-based media system 200 can continuously or periodicallymonitor audio content that is being played in the vehicle device andbegin capturing audio content upon recognizing one or more predeterminedaudio patterns that might indicate that an advertisement is playing. Inthis way, the audio content in the vehicle can be continuously monitoredfor purposes of determining if an advertisement is playing.

In still other examples, the vehicle-based media system 200 may captureaudio content in the vehicle based on the presence (or absence) orparticular information in the received audio content. For example, thevehicle-based media system 200 may begin capturing audio content playingin the vehicle in response to determining that the received audiocontent contains information indicating that the audio content is anadvertisement. For instance, the vehicle-based media system can begincapturing audio content responsive to determining that the receivedaudio content contains embedded information that indicates the audiocontent is an advertisement, but does not indicate any details of theadvertisement. In other examples, the vehicle-based media system 200 maybegin capturing audio content playing in the vehicle in response todetermining that the received audio content does not contain certaininformation. For example, the vehicle-based media system 200 candetermine that the audio content does not contain information indicatingthat the audio content is musical content (e.g., song and/or artisttitle), and thereby determine that the audio content is more likely thannot an advertisement. Other examples are possible.

The vehicle-based media system 200 can also use the captured audiocontent to identify reference audio content that has at least athreshold extent of similarity with the captured audio content and cando so in a number of ways.

In one example, the vehicle-based media system 200 itself can generateaudio fingerprint data based on the captured audio content (e.g., byprocessing the captured audio content locally) and then send thegenerated audio fingerprint data to a second computing device (e.g., anetwork server) with an instruction that causes the second computingdevice to compare the generated audio fingerprint data to a plurality ofreference audio fingerprint items and determine that one or morereference audio fingerprint items have at least a threshold extent ofsimilarity with the generated audio fingerprint data. This similaritymay indicate a match between the captured audio content and knownreference audio content, thereby allowing the vehicle-based media system200 to display information about the captured audio content based on itssimilarity to the known reference audio content (e.g., names and/orslogans for certain businesses).

In another example, the vehicle-based media system 200 can identify thereference audio content locally by generating audio fingerprint data ofthe captured audio content and comparing the generated audio fingerprintdata to a plurality of locally stored reference audio fingerprint items,each of which are associated with respective reference audio content.Then, based on this comparison, the vehicle-based media system 200 canalso determine that a particular reference audio fingerprint item has atleast a threshold extent of similarity with the generated audiofingerprint data.

In yet another example, the vehicle-based media system 200 can send aportion of the captured audio content to an external computing device(e.g., a network server) with an instruction that causes the externalcomputing device to compare, at least, the portion of the captured audiocontent to the plurality of reference audio content items. Such acomparison can involve the external computing device generating an audiofingerprint of the portion of the captured audio content and comparingthe generated audio fingerprint to respective reference audiofingerprints, each of which can correspond to a respective referenceaudio content item. Then, once the external computing device performsthis comparison, the vehicle-based media system 200 may receive, fromthe external computing device, an indication of a particular referenceaudio content item that has at least the threshold extent of similaritywith the captured audio content.

Based on the results of this comparison, the vehicle-based media system200 can also identify geographic location data associated with thereference audio content. In some examples, to identify this associatedgeographic location, the vehicle-based media system 200 may use thereference audio content corresponding to the fingerprint data of theadvertisement to retrieve geographic location data associated with oneor more advertisements, and may do so in a variety of ways. In someexamples, the vehicle-based media system 200 may obtain this geographiclocation data from local storage and/or from other devices, among otherpossibilities. In a further aspect, the vehicle-based media system mayidentify respective geographic location data for each (or at least some)of the respective reference audio fingerprint item of the plurality ofaudio fingerprint items based on a variety of factors.

Further, the vehicle-based media system 200 can use this identifiedgeographic location data in a number of ways. In one example, thevehicle-based media system 200 can display a prompt to navigate to oneor more identified geographic locations related to particularadvertisement while the advertisement is playing in the vehicle. In afurther aspect, this prompt may contain content additional content thatincreases opportunities for (and the likelihood of) an occupant'sinteractions with the advertisement content.

For example, as shown in FIG. 2B, the vehicle-based media system 200displays visual content 212 corresponding to a particular advertisementthat includes a business logo 214 (here, “Core4 Coffee Roasters”)associated with the advertisement and a navigation prompt 216 (here,“ROUTE TO NEARBY LOCATION?”). Again, this content may increase anoccupant's experience with the underlying advertisement content (e.g.,by providing even more content to an occupant of the vehicle whenscanned by an occupant's mobile computing device). Other examples arepossible.

Further, this advertising visual content 212 and associated navigationprompt 216 may be displayed at various times in connection with theunderlying advertisement content. For example, advertising visualcontent 212 and associated navigation prompt 216 may be retrieved anddisplayed in real time while the underlying advertisement content isplaying in the vehicle. Further, the advertising visual content 212 andassociated navigation prompt 216 may be displayed only while theunderlying advertisement content is playing in the vehicle, during aportion of playback for a subsequent advertisement or musical audiocontent, for a particular duration (e.g., 30 seconds), persistentlyuntil an occupant takes one or more predetermined actions (e.g., selectsthe navigation prompt 216, or closes the advertisement by interactingwith the user interface of the vehicle-based media system), and/or whenthe vehicle's radio is turned off and/or performing other functionality(e.g., playing a CD), among other possibilities. For example,advertising visual content 212 and associated navigation prompt 216 mayalso be displayed the next time the vehicle is started, regardless ofthe audio content that is playing when the vehicle is started. Otherexamples and uses of associated information are possible.

Turning to FIG. 2C, the GUI of the vehicle-based media system 200 isshown in a third state, where the third state is similar to the secondstate depicted in FIG. 2B, in that the vehicle-based media system 200has captured audio content, used that captured audio content to identifyreference audio content having at least a threshold similarity with thecaptured audio content, and identified associated geographic locationdata. However, in this third state, the user has selected the navigationprompt 216, vehicle-based media system 200 has captured location data ofthe vehicle, and vehicle-based media system 200 is using that locationdata to identify and display directions to a nearby geographic locationof the business.

Specifically, in order to reach the third state shown in FIG. 2C, at oraround the time the vehicle-based media system 200 uses the microphoneto capture audio content, the vehicle-based media system 200 can alsodetermine location data of the vehicle (e.g., using GPS). As describedabove, the vehicle-based media system 200 can use the determinedlocation data to filter out geographic locations associated with theadvertising content that are outside a threshold proximity of thelocation data and instead only select one or more geographic locationsthat are within the threshold proximity of the vehicle-based mediasystem 200. In this manner, the selected navigation directions aredisplayed for a specific location of the advertised business that isrelatively near to the vehicle-based media system. As shown in FIG. 2C,the vehicle-based media system can output, in connection with theindication of the identified reference audio content, an indication ofnavigation directions to the nearby business via a navigation GUI 218,that can include indications of the current geographic location of thevehicle 220 and a displayed route 222 to a nearby advertised businesslocation 224. Other examples of displayed information pertaining to thisis navigational view are possible (e.g., displaying alternatenavigational directions to a single determined geographic location ofthe advertised business, multiple navigational directions to multipledetermined geographic locations of the advertised business, estimatednavigational times of one more routes, traffic conditions of one or moreroutes, etc.). In any event, by displaying location-specific visualcontent, the occupant's experience with the advertisement (and therebythe advertiser) may be further improved.

FIG. 3A depicts an example GUI of the vehicle-based media system 300 ina first state. Specifically, in this first state, the vehicle-basedmedia system 300 displays navigation GUI 302, that can includeindications of the current geographic location of the vehicle 304 and adisplayed route 306 to a particular destined geographic location 308.While in the first state, the vehicle-based media system 300 canconcurrently receive and output audio content, including entertainmentcontent and advertisement content interspersed among the entertainmentcontent, as described above. Further, while in this first state, thevehicle-based media system 300 can capture the output audio content todetermine whether the audio content includes known advertisementcontent, as also described above.

FIG. 3B depicts the GUI of vehicle-based media system 300 depicted inFIG. 3A, but in a second state. The vehicle-based media system 300 candisplay the GUI in the second state in response to determining that theaudio content includes a known advertisement according to the techniquesdescribed above. In the second state, vehicle-based media system 300displays a nearby business location 310 of an advertised business and anassociated navigation prompt 312 (here, “Route to Nearby Core4 CoffeeRoasters?), which can be displayed concurrently with the advertisementplaying on the radio station (and/or soon thereafter). To do so, in thisexample, during playout of this advertisement, the vehicle-based mediasystem 300 captures the advertisement audio content currently playing onone or more speakers in the vehicle. Additionally, in line with thediscussion above, this information can be encoded into audio contentreceived by the vehicle-based media system, and the vehicle-based mediasystem can extract this information from the received audio content.

Further, the vehicle-based media system 300 can be configured such that,in response to receiving a selection of the prompt 312, thevehicle-based media system alters the route 306. For instance, once theoccupant selects the prompt 312, the vehicle-based media system 300alters the displayed route 306 in order to navigate the vehicle to thenearby business location 310 of the advertised business. This alteredroute is illustrated in FIG. 3C as route 314. Other examples arepossible.

B. Example Methods

FIG. 4 is a flow chart illustrating an example method 300.

At block 402, the method 400 can include receiving audio content. Insome examples, receiving the audio content includes receiving primaryaudio content and secondary audio content, wherein the primary audiocontent comprises entertainment content, and wherein the secondary audiocontent comprises advertisement content interspersed among the primarycontent.

At block 404, the method 400 can include causing one or more speakers tooutput the received audio content. In some examples, causing the one ormore speakers to output the received audio content includes causing theone or more speakers to output primary audio content (i.e.,entertainment content) and secondary audio content (i.e., advertisementcontent).

At block 406, the method can include using the microphone of thevehicle-based media system to capture the output audio content. In someexamples, using the microphone of the vehicle-based media system tocapture the output audio content includes using the microphone of thevehicle-based media system to capture the secondary audio content.

At block 408, the method 400 can include identifying reference audiocontent that has at least a threshold extent of similarity with thecaptured audio content. In some examples, identifying reference audiocontent that has at least the threshold extent of similarity with thecaptured audio content includes identifying reference audio content thathas at least the threshold extent of similarity with the capturedsecondary audio content. In some examples, identifying the referenceaudio content that has at least the threshold extent of similarity withthe captured audio content includes: (i) generating audio fingerprintdata of the captured audio content, (ii) comparing the generated audiofingerprint data to a plurality of reference audio fingerprint items,and (iii) determining that a particular reference audio fingerprint itemof the plurality of reference audio fingerprint items has at least thethreshold extent of similarity with the generated audio fingerprintdata.

At block 410, the method 400 can include identifying a geographiclocation associated with the identified reference audio content. In someexamples, the identified geographic location associated with theidentified reference audio content is a first geographic location, andmethod 400 can also include determining a second geographic locationassociated with the vehicle-based media system. In a further aspect,determining the second geographic location associated with thevehicle-based media system can also include determining (i) a currentgeographic location of the vehicle-based media system, (ii) a destinedgeographic location of the vehicle-based media system, and/or (iii) ageographic location on a route between the current geographic locationof the vehicle-based media system and the destined geographic locationof the vehicle-based media system. In some examples, identifying thegeographic location associated with the identified reference audiocontent can include identifying a geographic location related to theparticular advertisement content of the secondary audio content.

At block 412, the method 400 can include, based at least on theidentified geographic location associated with the identified referenceaudio content, outputting, via the user interface of the vehicle-basedmedia system, a prompt to navigate to the identified geographiclocation. In some examples, outputting the prompt to navigate to theidentified geographic location can include outputting a prompt tonavigate to the first geographic location based on the first geographiclocation being within a threshold proximity of the second geographiclocation. In other examples, outputting the prompt to navigate to theidentified geographic location can include, while causing the one ormore speakers to output the particular advertisement content of thesecondary audio content, outputting the prompt to navigate to thegeographic location related to the particular advertisement content.

In some examples, the method 400 can also include receiving, via theuser interface of the vehicle-based media system, a selection of theprompt to navigate to the identified geographic location and, inresponse to receiving the selection of the prompt, outputting, via theuser interface of the vehicle-based media system, directions fornavigating to the identified geographic location. As described above,this can allow the vehicle-based media system to retrieve and displaylocation-specific content to the occupants of the vehicle (e.g.,directions to a nearby location of the advertised business), potentiallywhile the advertisement is playing in the vehicle.

IV. Example Variations

Although some of the acts and/or functions described in this disclosurehave been described as being performed by a particular entity, the actsand/or functions can be performed by any entity, such as those entitiesdescribed in this disclosure. Further, although the acts and/orfunctions have been recited in a particular order, the acts and/orfunctions need not be performed in the order recited. However, in someinstances, it can be desired to perform the acts and/or functions in theorder recited. Further, each of the acts and/or functions can beperformed responsive to one or more of the other acts and/or functions.Also, not all of the acts and/or functions need to be performed toachieve one or more of the benefits provided by this disclosure, andtherefore not all of the acts and/or functions are required.

Although certain variations have been discussed in connection with oneor more examples of this disclosure, these variations can also beapplied to all of the other examples of this disclosure as well.

Although select examples of this disclosure have been described,alterations and permutations of these examples will be apparent to thoseof ordinary skill in the art. Other changes, substitutions, and/oralterations are also possible without departing from the invention inits broader aspects.

1. A vehicle-based media system comprising: a user interface; one or more processors; and a non-transitory, computer-readable medium storing instructions that, when executed by the one or more processors, cause the vehicle-based media system to perform a set of operations comprising: receiving audio content; identifying reference audio content that has at least a threshold extent of similarity with the received audio content; identifying a geographic location associated with the identified reference audio content; and based at least on the identified geographic location associated with the identified reference audio content, outputting, via the user interface of the vehicle-based media system, a prompt to navigate to the identified geographic location and advertising content associated with the identified geographic location.
 2. The vehicle-based media system of claim 1, wherein the identified geographic location associated with the identified reference audio content is a first geographic location, wherein the set of operations further comprises determining a second geographic location associated with the vehicle-based media system, and wherein outputting the prompt to navigate to the identified geographic location comprises outputting a prompt to navigate to the first geographic location based on the first geographic location being within a threshold proximity of the second geographic location.
 3. The vehicle-based media system of claim 2, wherein determining the second geographic location associated with the vehicle-based media system comprises determining (i) a current geographic location of the vehicle-based media system, (ii) a destined geographic location of the vehicle-based media system, or (iii) a geographic location on a route between the current geographic location of the vehicle-based media system and the destined geographic location of the vehicle-based media system.
 4. The vehicle-based media system of claim 1, wherein receiving the audio content comprises receiving primary audio content and secondary audio content, wherein the primary audio content comprises entertainment content, and wherein the secondary audio content comprises advertisement content interspersed among the primary content, and wherein the advertisement content is associated with the outputted advertising content.
 5. The vehicle-based media system of claim 4, wherein: identifying reference audio content that has at least the threshold extent of similarity with the received audio content comprises identifying reference audio content that has at least the threshold extent of similarity with the received secondary audio content.
 6. The vehicle-based media system of claim 5, wherein identifying the geographic location associated with the identified reference audio content comprises identifying a geographic location related to particular advertisement content of the secondary audio content, and wherein outputting the prompt to navigate to the identified geographic location comprises, outputting the prompt to navigate to the geographic location related to the particular advertisement content, and wherein the particular advertisement content is associated with the outputted advertising content.
 7. The vehicle-based media system of claim 1, wherein the set of operations further comprises: receiving, via the user interface of the vehicle-based media system, a selection of the prompt to navigate to the identified geographic location; and in response to receiving the selection of the prompt, outputting, via the user interface of the vehicle-based media system, directions for navigating to the identified geographic location.
 8. The vehicle-based media system of claim 1, wherein identifying the reference audio content that has at least the threshold extent of similarity with the received audio content comprises: generating audio fingerprint data of the received audio content; comparing the generated audio fingerprint data to a plurality of reference audio fingerprint items; and determining that a particular reference audio fingerprint item of the plurality of reference audio fingerprint items has at least the threshold extent of similarity with the generated audio fingerprint data.
 9. A method to be performed by a vehicle-based media system, the method comprising: receiving audio content; identifying reference audio content that has at least a threshold extent of similarity with the received audio content; identifying a geographic location associated with the identified reference audio content; and based at least on the identified geographic location associated with the identified reference audio content, outputting, via a user interface of the vehicle-based media system, a prompt to navigate to the identified geographic location.
 10. The method of claim 9, wherein the identified geographic location associated with the identified reference audio content is a first geographic location, wherein the method comprises determining a second geographic location associated with the vehicle-based media system, and wherein outputting the prompt to navigate to the identified geographic location comprises outputting a prompt to navigate to the first geographic location based on the first geographic location being within a threshold proximity of the second geographic location.
 11. The method of claim 10, wherein determining the second geographic location associated with the vehicle-based media system comprises determining (i) a current geographic location of the vehicle-based media system, (ii) a destined geographic location of the vehicle-based media system, or (iii) a geographic location on a route between the current geographic location of the vehicle-based media system and the destined geographic location of the vehicle-based media system.
 12. The method of claim 9, wherein receiving the audio content comprises receiving primary audio content and secondary audio content, wherein the primary audio content comprises entertainment content, and wherein the secondary audio content comprises advertisement content interspersed among the primary content, and wherein the advertisement content is associated with the outputted advertising content.
 13. The method of claim 12, wherein: identifying reference audio content that has at least the threshold extent of similarity with the received audio content comprises identifying reference audio content that has at least the threshold extent of similarity with the received secondary audio content.
 14. The method of claim 13, wherein identifying the geographic location associated with the identified reference audio content comprises identifying a geographic location related to particular advertisement content of the secondary audio content, and wherein outputting the prompt to navigate to the identified geographic location comprises, outputting the prompt to navigate to the geographic location related to the particular advertisement content, and wherein the particular advertisement content is associated with the outputted advertising content.
 15. The method of claim 9, wherein the method further comprises: receiving, via the user interface of the vehicle-based media system, a selection of the prompt to navigate to the identified geographic location; and in response to receiving the selection of the prompt, outputting, via the user interface of the vehicle-based media system, directions for navigating to the identified geographic location.
 16. The method of claim 9, wherein identifying the reference audio content that has at least the threshold extent of similarity with the received audio content comprises: generating audio fingerprint data of the received audio content; comparing the generated audio fingerprint data to a plurality of reference audio fingerprint items; and determining that a particular reference audio fingerprint item of the plurality of reference audio fingerprint items has at least the threshold extent of similarity with the generated audio fingerprint data.
 17. A non-transitory, computer-readable medium, having stored thereon program instructions that, upon execution by a vehicle-based media system, cause the vehicle-based media system to perform a set of operations comprising: receiving audio content; identifying reference audio content that has at least a threshold extent of similarity with the received audio content; identifying a geographic location associated with the identified reference audio content; and based at least on the identified geographic location associated with the identified reference audio content, outputting, via a user interface of the vehicle-based media system, a prompt to navigate to the identified geographic location.
 18. The non-transitory, computer-readable medium of claim 17, wherein the identified geographic location associated with the identified reference audio content is a first geographic location, wherein the set of operations further comprises determining a second geographic location associated with the vehicle-based media system, and wherein outputting the prompt to navigate to the identified geographic location comprises outputting a prompt to navigate to the first geographic location based on the first geographic location being within a threshold proximity of the second geographic location.
 19. The non-transitory, computer-readable medium of claim 18, wherein determining the second geographic location associated with the vehicle-based media system comprises determining (i) a current geographic location of the vehicle-based media system, (ii) a destined geographic location of the vehicle-based media system, or (iii) a geographic location on a route between the current geographic location of the vehicle-based media system and the destined geographic location of the vehicle-based media system.
 20. The non-transitory, computer-readable medium of claim 17, wherein: receiving the audio content comprises receiving primary audio content and secondary audio content, the primary audio content comprising entertainment content, and the secondary audio content comprising advertisement content interspersed among the primary content, identifying reference audio content that has at least the threshold extent of similarity with the received audio content comprises identifying reference audio content that has at least the threshold extent of similarity with the received secondary audio content, identifying the geographic location associated with the identified reference audio content comprises identifying a geographic location related to particular advertisement content of the secondary audio content, and outputting the prompt to navigate to the identified geographic location comprises outputting the prompt to navigate to the geographic location related to the particular advertisement content, and wherein the particular advertisement content is associated with the outputted advertising content. 